Evaluating Summaries for Multiple Documents in an Interactive Environment
نویسندگان
چکیده
While most people have a clear idea of what a single document summary should look like, this is not immediately obvious for a multidocument summary. There are many new questions to answer concerning the amount of documents to be summarized, the type of documents, the kind of summary that should be generated, the way the summary gets presented to the user, etc. The many approaches possible to multi-document summarization makes evaluation especially difficult. In this paper we will describe an approach to multidocument summarization and report work on an evaluation method for this particular system.
منابع مشابه
An Analysis of User Strategies for Examining and Processing Ranked Lists of Documents
The predominant display of document retrieval results is a ranked list of query-biased summaries. When examining and processing search results, users must make complex decisions about how to allocate their time and relevance judging effort between evaluation of summaries and the full documents reachable with a mouse click on a summary. We performed a cluster analysis of the search results proce...
متن کاملQuestion Answering, Relevance Feedback and Summarisation: TREC-9 Interactive Track Report
In this paper we report on the effectiveness of query-biased summaries for a question-answering task. Our summarisation system presents searchers with short summaries of documents, composed of a series of highly matching sentences extracted from the documents. These summaries are also used as evidence for a query expansion algorithm to test the use of summaries as evidence for interactive and a...
متن کاملSummarize What You Are Interested In: An Optimization Framework for Interactive Personalized Summarization
Most traditional summarization methods treat their outputs as static and plain texts, which fail to capture user interests during summarization because the generated summaries are the same for different users. However, users have individual preferences on a particular source document collection and obviously a universal summary for all users might not always be satisfactory. Hence we investigat...
متن کاملInteractive Document Summarisation
This paper describes the Interactive Document Summariser (IDS), a dynamic document summarisation system, which can help users of digital libraries to access on-line documents more effectively. IDS provides dynamic control over summary characteristics, such as length and topic focus, so that changes made by the user are instantly reflected in an on-screen summary. A range of ‘summary-in-context’...
متن کاملMachine and Human Performance for Single and Multidocument Summarization
coherency—and be able to draw the “best” information from a set of documents. Automatic single-document text summarization1 has been an active research area since the 1950s, with a renaissance of approaches since the 1990s. Human single-document summarization is well defined when guidelines and recommendations drive performance.2,3 System-generated single-document summaries, while not always ma...
متن کامل